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— DEVICE AND METHOD FOR GENERATING A VIRTUAL ANATOMIC 

ENVIRONMENT 

Technical field of the invention 

This invention relates to a method for generating a 
virtual anatomic environment for use in minimally inva- 
5 sive surgery simulation. The invention further relates to 
such a computer-based minimal -invasive surgery simulation 
system. 

Background of the invention 

10 

In modern surgery , minimal invasive techniques are 
used in more and more applications. The development of 
technology within this relatively new field advances 
quickly, which results in great training requirements' for 

15 surgeons. One way of rendering the training more effec- 
tive is to use computer simulations. Known techniques for 
providing a credible simulation are very complicated and 
expensive with respect to computer utility in the form of 
processor and memory. Moreover, the result is not suffi- 

20 cient to provide a realistic simulation environment. The 
visual properties that the anatomy exhibits in reality 
are difficult and time-consuming to recreate in a simula- 
tion. 

By means of modern computer engineering, it is pos- 
25 sible to provide realistic training situations in a vir- 
tual environment created by a computer program. In the 
computer program, a three-dimensional model of the object 
which the simulation concerns is provided. The user is 
provided with a projection thereof which should corre- 
3 0 spond to the picture information which in a real situa- 
tion is caught by a camera. Within the field of laparo- 
scopy, a camera is used to supply picture information 
from the patient to the surgeon. The display screen shows 
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the picture that the camera catches of the inside of, for 
example, the abdominal cavity. All the instruments and 
the anatomy with which the surgeon works are reproduced 
by means of the camera and the display screen. The sur- 
5 geon uses the information on the display screen to con- 
trol and operate his or her instruments and carry out the 
procedures which are required to perform the surgical op- 
eration. Since the minimal invasive techniques supply in- 
formation to the surgeon by means of a display screen, 

10 the three-dimensional reality is reduced to two dimen- 
sions on the display screen. The picture therefore lacks, 
among other things, the information as to depth that ex- 
ists in reality. The surgeon has to make up for this loss 
of information by studying lighting conditions, colours, 

15 etc. 

This means that all visual inf ormation, such as in- 
strument and anatomy, is drawn by the computer. However, 
many complicated processes within the field of surgery 
are expensive, if not impossible, to fully simulate in a 
2 0 computer. For example, a large part of the picture 
information that the surgeon uses in real life, for 
example light effects and anatomic structures, factors 
such as breathing and beat of the pulse, which are 
present in the real situation are difficult to recreate 

2 5 realistically in the computer. Moreover, due to different 

biological anatomic variations occurring in humans, it is 
difficult to fully simulate a situation confronting a 
surgeon when he is to perform an operation. Some efforts 
have been made to generate simulation systems providing 

3 0 random variations of certain elements, such as the 

thickness of an artery, in order to provide a more re- 
alistic simulation environment. However, such random 
variations are not enough to fully prepare a surgeon on 
what to expect when performing minimal -invasive surgery. 
35 Moreover, the more alterations of this type that are made 
during simulation, during simulation, the more computer 
capacity is needed, making such systems expensive. Hence, 
a method for providing a more realistic simulation 
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viding a more realistic simulation result, at the same 
time saving computer capacity, is desired, in order to 
provide a realistic, cost-efficient system for minimal- 
invasive surgery simulation. 

5 

Summary of the invention 

Hence, an object of the present invention is to pro- 
vide a method and system for use in minimally invasive 

10 surgery simulation system, in order to generate a realis- 
tic simulation environment, and which wholly or partly 
solve the above-mentioned problems. 

These and other objects are at least partly achieved 
by a method for generating a virtual anatomic environment 

15 for use in minimally invasive surgery simulation, com- 
prising the steps of: incorporating a main virtual anat- 
omic environment, selecting a local anatomic environment 
from a predefined library comprising a set of two or more 
simulated local anatomic environments, and including the 

2 0 selected local anatomic environment in said main anatomic 

environment to form a total virtual anatomic environment. 
This enables a total virtual anatomic environment, in 
which simulation may be performed, to be built-up by 
separately modelled components. By using different build- 
25 ing components, as stored in the library, different total 
virtual anatomic environments may be generated, without 
modelling the entire environment from the beginning. This 
also enables that the manufacturer may have a total con- 
trol over what variations are stored in the library, and 

3 0 hence what total virtual anatomic environments that may 

be generated, as opposed to randomise alterations of 
separate components of the environment. 

Preferably, said set of local anatomic environments 
is arranged to represent a set of anatomic variations for 
35 a critical internal area, occurring in living beings. 

Thereby, a straight -forward method of achieving a simula- 
tion system, covering anatomic variations, such as dif- 
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ferent configurations of arteries and ducts around an or- 
gan, or different organ shapes (and so on) is realised. 

Moreover, the step of selecting a local anatomic en- 
vironment from a predefined library comprising two or 
5 more of simulated local anatomic environments suitably 
further comprises the step of randomly selecting one of 
the local anatomic environments in the library. Thereby, 
a user of the simulation system does not know in advance 
what anatomic environment will be presented to him. This 

10 provides a realistic situation for the user, and gives 

the user the opportunity to learn to tell the difference 
between different anatomic environments, that may look: 
similar at a first glance. Preferably, the probability of 
randomly selecting a certain local anatomic environment 

15 essentially corresponds with the degree of occurrence of 
that local anatomic environment in living beings, in or- 
der to further provide a realistic simulation environ- 
ment . 

According to a preferred embodiment of the inven- 

2 0 tion, the main virtual anatomic environment is arranged 

to model an internal cavity of a human, such as an ab- 
dominal cavity or a chest cavity, while the set of local 
anatomic environments is arranged to simulate different 
arrangements of arteries, veins and ducts around an organ 
25 arranged in said internal cavity, such as a gall bladder 
or a heart . 

According to another embodiment, the inventive 
method further comprises the step of selecting, by means 
of user selection, a certain one of said local anatomic 

3 0 environments from said library and including it into said 

main virtual environment. This enables a user to practice 
surgery in a certain selected environment, for example to 
improve his or her skills on that certain environment, or 
to prepare for a real surgery of a patient exhibiting a 
35 similar environment. 

The above and other objects are at least partly achieved 
by a device for generating a virtual anatomic environment 
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for use in minimally invasive surgery simulation, com- 
prising a modelling device for providing a main virtual 
anatomic environment, a library, comprising a set of two 
or more predefined local anatomic environments, and means 
5 for incorporating one of the local anatomic environments 
of the library into the main virtual anatomic environ- 
ment, together forming a total virtual anatomic environ- 
ment. Such a device enables a total virtual anatomic en- 
vironment, in which simulation may be performed, to be 

10 built-up by separately modelled components. By using dif- 
ferent building components, as stored in the library, 
different total virtual anatomic environments may be gen- 
erated, without modelling the entire environment from the 
beginning. This also enables that the manufacturer may 

15 have a total control over what variations is stored in 

the library, and hence what total virtual anatomic envi- 
ronments that may be generated, as opposed to randomise 
alterations of separate components of the environment . 
This may be advantageous from an educational point of 

2 0 view. 

Preferably, the device further comprises a selection 
device for selecting one of said local anatomic environ- 
ments from said library to be included in said main anat- 
omic environment, and suitably, the selection device is 

25 arranged to randomly select one of said local anatomic 
environments from said library to be included in said 
main anatomic environment. Thereby, a user of the simula- 
tion system does not know what anatomic environment will 
be presented to him. This provides a realistic situation 

30 for the user, and gives the user the opportunity to learn 
to tell the difference between different anatomic envi- 
ronments, that may look similar at a first glance. Pref- 
erably, the selection device is arranged to randomly se- 
lect one of said local anatomic environments in such a 

3 5 way that the probability of choosing a certain local 

anatomic environment essentially corresponds with the de- 
gree of occurrence of that local anatomic environment in 



WO 2004/029910 



PCT/SE2003/001514 



6 

human beings, further improving the realism of the simu- 
lated surgery. 

According to a preferred embodiment of the inven- 
tion, the main virtual anatomic environment is arranged 
5 to model an internal cavity of a human, such as an ab- 
dominal cavity or a chest cavity, while the set of local 
anatomic environments is arranged to simulate different 
arrangements of arteries, veins and ducts around an organ 
arranged in said internal cavity, such as a gall bladder 
10 or a heart. 

Also, the above and other objects of the invention 
are achieved by a computer-based minimal -invasive surgery 
simulation system, comprising a device for generating a 
virtual anatomic environment as described above. 

15 

Brief description of the drawings 

The invention will hereinafter be described in 
closer detail by means of presently preferred embodiments 
2 0 thereof, with reference to the accompanying drawings. 

Fig 1 is a schematic view of the basic components of 
a simulation system in which the present invention may be 
implemented. 

Fig 2 is a block diagram of a simulation system ac- 
2 5 cording to an embodiment of the invention. 

Fig 3 is a block diagram describing the inventive 
device for generating a virtual anatomic environment for 
use in a minimally invasive surgery simulation system as 
shown in fig 1 or. 2 . 

30 

Description of preferred embodiments of the invention 

Hereinafter, reference will be made in detail to a 
preferred embodiment of this invention, which is illus- 
35 trated in the accompanying drawings. 

As stated above this invention relates to the field 
of computer-based minimal -invasive surgery simulation 
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systems, and a schematic drawing of the basic hard-ware 
components of such a system, in which the present inven- 
tion may be incorporated, is disclosed in fig 1. Such a 
system essentially comprises a processing unit 10 for 
5 simulating a minimal -invasive surgery situation, a surgi- 
cal tool input device 11, for inputting information re- 
garding movements etc of a surgical tool to be manoeuvred 
by a user to the processing unit 10, and a display device 
12 for displaying the simulated surgery procedure in or- 

10 der to visualise the simulated surgery situation for the 
user. The processing unit may, for example, comprise a 
personal computer which is preferably equipped with a 
graphics card having 3D-circuits. Moreover, the surgical 
tool input device 11 may or may not be provided with a 

15 system for tactile feedback to the user of the system. 

The processing unit 10, as disclosed in fig 1, will 
hereinafter be described in closer detail with reference 
to fig 2. The processing unit essentially comprises a to- 
tal virtual anatomic environment modeller 14, for provid- 

2 0 ing a model of a total virtual anatomic environment 2 to 
an interaction simulation device 13 . The interaction 
simulation device 13 is also arranged to receive informa- 
tion regarding movements etc. of the surgical tool input 
device 11. Based on information from the total virtual 

2 5 anatomic environment modeller 14 and the surgical tool 

input device 11, the surgical procedure is simulated by 
said interaction simulation device 13, and the resulting 
simulation is outputted to the display device 12, whereby 
it is displayed for a user. 
30 This invention is focused on the generation of the 

total virtual anatomic environment 4, generated by said 
total virtual anatomic environment modeller 14. According 
to the invention, the processing unit 10 further com- 
prises a main virtual anatomic environment modeller 15, 

3 5 for providing a model of a main virtual anatomic environ- 

ment 1, as well as a local anatomic environment library 
3, for providing a model of a local virtual anatomic en- 
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vironment 2. The main virtual anatomic environment model- 
ler 15 and the local anatomic environment library 3 are 
both connected with the total virtual anatomic environ- 
ment modeller 14. 
5 The main virtual anatomic environment modeller 15 is 

arranged to model and provide a model of a main virtual 
anatomic environment 1 to the total virtual anatomic en- 
vironment modeller 14, while the local anatomic environ- 
ment library 3 is arranged to store a two or more mod- 

10 elled local anatomic environments 2, and providing one of 
those to the total virtual anatomic environment modeller 
14. Together, the main virtual anatomic environment 1 and 
the local anatomic environment 2 may form a total anat- 
omic environment, in which simulation may be performed. 

15 The term "local virtual anatomic environment" as 

used herein shall be understood as a 3-D model of a local 
internal area of a living being, that is critical during 
the surgery procedure that is to be simulated. For exam- 
ple, the local virtual anatomic environment may comprise 

2 0 a and organ 6, such as a gall bladder or a heart and the 
veins, arteries and ducts 7 surrounding the organ 6. How- 
ever, the invention may be used for simulation of virtu- 
ally any internal area, and hence, the invention is not 
limited to the above examples . 

25 The term "local virtual anatomic environment li- 

brary " as used herein shall be understood as a library 
containing two or more local virtual anatomic environ- 
ments as defined above, said environments forming a set 
of environments. The set of environments may for example 

30 comprise a plurality of environments each modelling a 

biological variation in the selected local internal area. 
As an example, environmental models of different configu- 
rations of the veins, arteries and ducts surrounding the 
gall bladder, that are present in human beings may be 

35 stored in the library, as is disclosed in fig 3. In the 

present example, in order to cover the biological variety 
to an extent of approximately 99% of all humans, the set 
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should contain about 16 different local virtual anatomic 
■ environments. Another example, for which the invention 
may be used, is different configurations of veins, arter- 
ies and ducts surrounding the heart. 
5 The term "main virtual anatomic environment 7 ' as used 

herein shall be understood as a 3-D model of an internal 
area of a living being, essentially surrounding the local 
internal area described above. An example of such an in- 
ternal area is the abdominal cavity (for the example with 

10 a gall bladder) or the chest cavity (for the example with 
the heart) . The components included in the local virtual 
anatomic environment are. excluded in the main virtual 
anatomic environment. For example, if the local virtual 
anatomic environment contains the gall bladder and the 

15 surrounding arteries and ducts, the main virtual anatomic 
environment does not include those components, but only 
connecting arteries, and ducts and so on. Alternatively, 
the local virtual anatomic environment may only comprise 
the arteries and ducts surrounding the gall bladder, 

2 0 while the gall bladder itself is included in the main 

virtual anatomic environment . 

The device further comprises a selection device 9, 
for selecting one of the local anatomic environments 2 
25 stored in the local anatomic environment library 3. This 
selection device may be realised in various different 
ways . 

According to a first example, the selection device 
9may be provided with an input device (not shown) , so 

3 0 that a user actively may select what local anatomic envi- 

ronment should be selected and included into the main 
virtual anatomic environment. This may for example be re- 
alised through a computer input interface, using a mouse 
or the like. The above enables training in a user- 
35 selected environment, for improving the user's skills re- 
garding a certain biological variation, as defined by the 
selected local anatomic environment 2 . Thereby, a user 
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(surgeon) may train on a surgery procedure of a patient, 
exhibiting a certain biological variation, before per- 
forming the surgery. Moreover, the user may specifically 
train on procedures in local anatomic environments which 
5 they are less familiar with, thereby improving the over- 
all quality of the surgery training. 

According to a second example, the selection device 
9 may be arranged as a random selection device, for ran- 
domly selecting one of the local anatomic environments 2, 

10 stored in the local anatomic environment library 3. This 
provides a realistic training situation, since, in most 
cases, a surgeon is not aware of what biological varia- 
tion a patient exhibits until the surgery procedure has 
started. It is then of great importance to quickly be 

15 able to recognize the different biological variations, in 
order to perform a correct procedure. Hence, a selection 
device according to this example facilitates such train- 
ing. In order to further enhance the realism of the sur- 
gical training, the selection device 9 may be arranged to 

20 randomly select one of the local anatomic environments 2, 
as described above, whereby the random selection is such 
that the probability of selecting a certain local anat- 
omic environment essentially corresponds with the degree 
of occurrence of that local anatomic environment in human 

25 beings. This may for example be realised by means of pro- 
viding each local anatomic environment 2 of the library 3 
with a weight, corresponding to the occurrence of the 
biological variation being represented by the local anat- 
omic environment 2 in question. 

30 As stated above, the 3-D model of the main virtual 

anatomic environment 1 and the 3-D model of the selected 
local anatomic environment 2 is transmitted to the total 
virtual anatomic environment modeller 14, in which the 
local anatomic environment 2 is positioned in its desired 

35 position in the main virtual anatomic environment 1, to- 
gether forming a total virtual anatomic environment. 
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The total anatomic environment, as modelled by the 
total anatomic environment modeller 14, is thereafter 
transmitted to the interaction simulation device 13, in 
which the total anatomic environment is used for perform- 
5 ing the simulation, and the interaction with the inputted 
movements and actions of the surgical tool. Thereafter, 
the simulation result is transmitted to and displayed by 
the display device 12 . 

Many modifications, improvements and variations of 

10 the above described embodiments of the invention are ob- 
vious for the man skilled in the art, and such modifica- 
tions, improvements and variations are intended to form a 
part of the disclosure, and are also intended to fall 
within the scope and spirit of this invention as defined 

15 by the appended claims. Hence, the above description of 
preferred embodiments is only given by way of example, 
and the invention is only to be limited to what is stated 
in the following claims, taking any equivalents into ac- 
count . 

20 For example, it shall be noted that the incorpora- 

tion of the local virtual anatomic environment 2 into the 
main virtual anatomic environment may alternatively take 
place directly in the interaction simulation device 13, 
hence excluding the total virtual anatomic environment 

25 modeller 14 as a separate component. 



